Human interface apparatus having input unit for pointer location information and pointer command execution unit

ABSTRACT

A human interface apparatus comprising the steps of: receiving text input from a user; switching to input mode for pointing location information; receiving input for pointing location information from the user; and switching the human interface apparatus to a text input mode, wherein the text input area and the pointing location information input area have at least a part of the area in common.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.14/403,998, filed on Nov. 25, 2014, which is the National Stage filingunder 35 U.S.C. 371 of International Application No. PCT/KR2012/011822,filed on Dec. 29, 2012, which claims the benefits of Korean PatentApplication No. 10-2012-0056427, filed on May 28, 2012, Korean PatentApplication No. 10-2012-0061197, filed on Jun. 8, 2012, Korean PatentApplication No. 10-2012-0074248, filed on Jul. 9, 2012, Korean PatentApplication No. 10-2012-0104272, filed on Sep. 20, 2012, Korean PatentApplication No. 10-2012-0110998, filed on Oct. 6, 2012, Korean PatentApplication No. 10-2012-0125755, filed on Nov. 8, 2012, Korean PatentApplication No. 10-2012-0129166, filed on Nov. 15, 2012, Korean PatentApplication No. 10-2012-0152644, filed on Dec. 24, 2012 and KoreanPatent Application No. 10-2012-0156853, filed on Dec. 28, 2012, thecontents of which are all hereby incorporated by reference herein intheir entirety.

FIELD OF THE INVENTION

The present invention relates to a human interface configured to receivetext information or pointing location information from a user in adigital device, which can receive text or pointing location relatedinformation, such as a computer, a notebook (or laptop computer), atablet PC, a mobile phone, and so on, and to transmit the receivedinformation to the digital device.

BACKGROUND ART

A text input device, such as a keyboard, which is configured to inputtext in a personal computer or portable (or mobile) digital device, hasbeen disclosed. Additionally, a pointing device, such as a mouse device,which is configured to control pointing locations of a pointer and toperform functions of the pointer, which is configured to control thedigital device, has also been disclosed.

DETAILED DESCRIPTION OF THE INVENTION Technical Objects

The related art text input device and pointing device were eitherprovided as separate devices or a pointing input area was configured ina separate area that is differentiated from a text input area of thetext input device. Under an operation environment, wherein text inputand pointing location information input and pointer execution commandinput are frequently shifted, due to an excessive number of movements ofthe hand, operation efficiency is being degraded.

Technical Solutions

By equipping a pointing location information input area of a pointingdevice at an upper portion of a text input area plane of a text inputdevice, and by equipping a shifting unit configured to shift to and froma text input mode and a pointing location information input mode, amongthe text input, the performance of a pointing input while minimizingmovements of the user's hand by simply shifting the input mode maybecome possible, and, accordingly, the operation efficiency may beenhanced.

Effects of the Invention

By integrating separately equipped text input device and pointing devicewith a single human interface device, product price and product size maybe reduced, and, by removing unnecessary operation in user manipulation,the operation efficiency may be enhanced.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary diagram of a multi human interfacedevice being equipped with a pointing device and a text input device.

FIG. 2 illustrates a flow chart describing an exemplary operation orderrespective to mode switching of a pointing device and a text device.

FIG. 3 illustrates exemplary embodiments of structures of a text inputdevice and a pointing device.

FIG. 4 illustrates exemplary embodiments of a pointer execution commandunit integrated mode shifting unit.

FIG. 5 illustrates exemplary embodiments of a structure of a pointerlocation information input device.

FIG. 6 illustrates a structural diagram of an infrared light-ray lasersensor module.

FIG. 7 illustrates an exemplary embodiment indicating a pointer locationinformation input area.

FIG. 8 illustrates a first exemplary embodiment of a pointer locationinformation input device that can be detached from a text input device.

FIG. 9 illustrates a second exemplary embodiment of a pointer locationinformation input device that can be detached from a text input device.

FIG. 10 illustrates a third exemplary embodiment of a pointer locationinformation input device that can be detached from a text input device.

FIG. 11 illustrates a front view diagram and a perspective view diagramof a human interface device having a low-positioned pointer locationinformation input device applied thereto.

FIG. 12 illustrates an exemplary embodiment of a pointer executioncommand unit integrated mode shifting unit.

FIG. 13 illustrates an exemplary embodiment of using a cover of a humaninterface device having a low-positioned pointer location informationinput device applied thereto.

FIG. 14 illustrates an exemplary embodiment of a human interface devicebeing applied to a mobile electronic device.

FIG. 15 illustrates an exemplary embodiment applying a low-positionedpointer location information input device and a low-positioned pointerexecution command unit.

MODE FOR CARRYING OUT THE PRESENT INVENTION

This relates to a multi human interface configured to receive textinformation or pointing location information from a user in a digitaldevice, which can receive text or pointing location related information,such as a computer, a notebook (or laptop computer), a tablet PC, amobile phone, and so on, and to transmit the received information to thedigital device.

A keyboard, which is configured of an elastic body and a plurality ofphysical buttons respectively connected to a switched, is being widelyused as a conventional text information input device.

Additionally, in a digital device equipped with a touch interface, whena virtual keyboard is displayed on a display, and when part of theuser's body touched the virtual keyboard, which is displayed on thedisplay, a method of inputting text through the virtual keyboard, whichis displayed on a portion that is touched by the user, by detecting theuser's gesture or electrical signal is also being used.

The touch interface may recognize the user's touch by recognizing amovement of a part of the user's body, or by recognizing a contact beingmade on a specific contact surface, or by detecting a flow of anelectric current through the user's body, or by detecting a blockage orinterference caused on light or sound wave, and so on, by a part of theuser's body.

Examples of a touchscreen interface includes a resistive touchscreen, acapacitive touchscreen, an optical touchscreen, a surface acoustic wave(or ultrasonic) touchscreen, and so on.

The resistive touchscreen corresponds to a touchscreen that isconfigured to be operated by recognizing pressure.

Although the resistive touchscreen is advantageous in that it islow-priced and that notes can be taken down or small letters can bewritten by using a stylus pen, the resistive touchscreen is also knownto be disadvantageous in that, due to its method of using pressure,touch cannot be recognized when pressed with too much force and alsothat the resistive touchscreen has a slow touch sensitivity as comparedto the capacitive touchscreen.

The resistive touchscreen is configured of a multiple layers.

Among such multiple layers, there is a conductive layer, and theconductive layer consists of two layers facing into each other whilehaving an air layer placed between the two layers.

When an outside of the screen is pressed, the two conductive layerstouch one another, and, due to such contact, a change occurs inresistance and electric currents, thereby allowing the touch to berecognized.

A capacitive sensing or capacitive touch method corresponds to a methodsensing movements by using a capacitance coupling effect.

Unlike the resistive touchscreen, which uses pressure, the capacitivetouchscreen is configured of a highly conductive glass, which isreferred to as Indium Tin Oxide.

By having sensors attached to each four corners of the glass, a surfaceof the glass is in a state of having electric currents flowing therein.

The principle of the capacitive method corresponds to recognizing achange in electric currents by using such glass.

When a finger touches the screen, electrodes flowing through the glassflow into the body through the finger, and, herein, the capacitivemethod corresponds to an operating method having the sensor detect alocation where such change in the electric currents occurs.

Instead of pressing on the screen by applying force, since thecapacitive touch method can recognize a touch by slightly touching thescreen, the capacitive touchscreen is known to provide smoothermanipulation and scrolling.

Additionally, the capacitive touch method can provide a multi-touchfunction, wherein several points can be touched.

Since the capacitive touch method corresponds to an operating methodthat uses a changed amount of electric currents, manipulation cannot beperformed when wearing leather gloves, through which electric currentscannot flow, or by using fingernails or a stylus pen.

However, the screen may be touched by using a capacitive touchscreenspecific separate stylus pen.

Since the sensor is highly sensitive, the capacitive touchscreen may beinfluenced by other surrounding devices.

The optical touchscreen is operated by measuring coordinates by using aninfrared light-ray camera, which is mounted on a vertex of thetouchscreen, and a shadow of an object intending to touch the screen,the shadow being created by the infrared light.

The surface acoustic wave (or ultrasonic) touchscreen is operated bymeasuring coordinates by emitting ultrasonic waves on the screen inorder to detect interference effects caused by the user's touch.

Additionally, diverse touch input technologies, which can be used forcontrolling location information of a pointer by recognizing locationinformation of the user's body part by detecting contact or movement ofthe user, may be used in the present invention.

FIG. 1 illustrates an exemplary diagram of a multi human interfacedevice being equipped with a pointing device and a text input device.

A pointing device integrated text input device may have a housing (100),which is configured to support a text input device and a pointerlocation information input area.

The housing is provided with a solidity (or strength) that can resistpressure of a user input, and the housing may be configured of a controlunit, a memory unit, a battery unit, an encoding unit, a transmittingunit, and so on, for receiving text input information and pointerlocation information input information and for transmitting thecorresponding information to a digital device, which is connected to thepointing device integrated text input device via wired or wirelessconnection.

The pointing device integrated text input device may be configured of aplurality of buttons (109) for receiving text input information from theuser.

The plurality of buttons (109) may consist of physical buttons orvirtual buttons.

The physical button consists of a button that is connected to an elasticbody or a button having its own elasticity, and the characteristics ofthe physical button is that, due to the elasticity of the button, whenthe button receives a user input, the button makes a position shift,and, when the user input is removed, the button returns to its initialposition.

The physical button is configured to be connected to an electricalswitch and, the physical button may be configured to have a structure,wherein, when pressure is applied by the user, the button makes aposition shift, and a phase of the switch is changed, thereby generatinga text input value of the corresponding button.

The physical button corresponds an elastic structure having no electricswitch, wherein the elastic structure is configured to perform positionshift after receiver a user input and returning to its initial positionwhen the user input is removed (or released), and text input informationof the user may generate text input information based upon locationinformation of a location where pressure or gesture of the user isrecognized by the above-described touch input device.

The virtual button may be configured by displaying a text input buttonon the display device.

The virtual button may correspond to an arbitrary button, which isdisplayed by projecting light on a transparent or semi-transparent ornon-transparent object.

The virtual button is not recognized by the user's eyes, yet the virtualbutton may generate the corresponding text input information based uponthe user pressure or gesture information by using the dedicated (orunique) location information for each text.

The multi human interface device may have a text input area (107) andpointing location information input areas (108 a, 108 b) each having atleast a portion as a common area.

The pointing location information input area (108 a, 108 b) correspondsto an area located at a surface or upper portion or lower portion of thebutton designated for text input, and, as shown in FIG. 1, the pointinglocation information input areas may share at least a portion with thetext input area.

The pointing location information input area may include the text inputarea, or the text input area may include the pointing locationinformation input area.

The pointing location information input area and the text input area mayhave at least a portion in common, and the at least one portion may beused as the pointing location information input area but not used as thetext input area, or the at least one portion may be used as the textinput area but not used as the pointing location information input area.

The multi human interface device may be configured to have a pointerlocation information input device (105), which is configured to create avirtual text input area or virtual pointing location information inputarea for inputting text or for inputting pointing location informationor for inputting text and pointing location information, equipped withinthe multi human interface device or equipped outside of the multi humaninterface device.

The pointer location information input device (105) may be configured ofdevices, such as an infrared light-ray generator and an infraredlight-ray receiver or an RGB camera or an ultrasonic generator and anultrasonic receiver or an infrared light-ray generator and an infraredlight-ray camera, and the pointer location information input device(105) may receive location information and gesture information bydetecting part of the user's body on the housing (100) surface or abovethe housing (100).

The pointer location information input device may be configured of aplurality of modules by being modulized in order to expand the inputarea or to enhance accuracy and sensitivity.

For example, a pointer location information input device (105 b) forconfiguring the text input or pointing location information input area(108 b) of a right hand may be provided.

Alternatively, a pointer location information input device (105 a) forconfiguring the text input or pointing location information input area(108 a) of a left hand may be provided.

The text input area or pointing location information input area (108 b),which is designated to the right hand, may include an area of a J buttonwithin an English standard keyboard.

The text input area or pointing location information input area (108 a),which is designated to the left hand, may include an area of an F buttonwithin an English standard keyboard.

In case the right hand and the left hand are not differentiated, thepointer location information input device may include both the area ofthe J button and the area of the F button within an English standardkeyboard.

In case the multi human interface device is connected to a plurality ofdigital devices each having a display unit, the pointing locationinformation input area may be capable of performing pointer locationshift within the plurality of display units.

For example, area division may be performed, so that the pointerlocation information input area can be matched to each display unit, ora separate button directing the display unit may be manipulated, so asto transmit pointer location information from the corresponding displayunit, or pointer location information may be transmitted, so that thepointer can shift its position within a virtual single display unit byrecognizing (or identifying) multiple display units as the virtualsingle display unit.

The multi human interface device includes a pointing locationinformation input device, which configures a pointing input area andreceives pointer location information from the user, and the multi humaninterface device may have a pointer execution command unit (101, 102),which is configured to execute at least one function within a button orimage or space or icon or text input window at which a pointer islocated, the pointer being moved (or re-located) by the pointinglocation information input device.

The pointer execution command unit may be configured of one button ortwo buttons, and each button is respectively in charge of a firstfunction and a second function, and each button may be located on a leftportion or a right portion or a center portion of the housing.

The first function, for example, may perform a same function as a leftclick of a computer mouse, and the second function, for example, mayperform a same function as a right click of a computer mouse.

The pointer execution command unit, which is configured of one button ortwo buttons, may be provided on both the left side and the right side ofthe housing.

The pointer execution command unit may be configured to be operated byrecognizing a touch of a part of the user's body or a blockage of lightor an interference of ultrasonic waves or a shadow of the user's bodypart by using the above-described touch technique.

The pointer execution command unit may be configured of physical buttonshaving elasticity

The pointer execution command unit may be configured to be operated byusing at least one button of text buttons, which are located within atext input area apart from the pointing location information input area.

The pointer execution command unit may be operated by selecting aphysical or virtual text button within the pointing location informationinput area.

For example, in case a virtual input device through which locationinformation can be inputted within a space is used as the pointinglocation information input device, and in case a physical button is usedas the text input device, by inputting location information of thepointer within a virtual pointing location information input area in apointing location information input mode and by pressing (or pushing) aphysical button, which is located at the corresponding location, apointer execution command may be generated.

The pointer execution command unit may receive pointer locationinformation by a first user gesture within the pointing locationinformation input area, and the pointer execution command unit maygenerate a pointer execution command by a second user gesture from thesame location.

The pointer execution command unit may be configured to have the firstfunction executed by using a first gesture of the user's body or a firstvoice, a first blink (or blink of the eye), a first shape of the mouth(or lips).

The pointer execution command unit may be configured to have the secondfunction executed by using a second gesture of the user's body or asecond voice, a second blink (or blink of the eye), a second shape ofthe mouth (or lips).

The multi human interface device may consist of a text input mode, whichcan receive text information through the text input device, and apointing location information input mode, which can receive pointinglocation information through the pointing location information inputdevice.

The text input mode and the pointing location information input mode maybe shifted by a mode shifting unit (103).

The mode shifting unit (103) may be configured of a switch that isseparately located on the housing.

The mode shifting unit (103) may execute mode shift by detecting atleast one text input button included in the text input device or asimultaneous reception of multiple text inputs.

The mode shifting unit (103) may perform mode shift by receiving controlinformation from a digital device that is connected to the multi humaninterface device via wired or wireless connection.

The mode shifting unit (103) may be configured to be integrated with thepointer execution command unit (102).

For example, configurations may be made, so that a mode can be shiftedby detecting a first touch or a first pressure made by a first gesture,such as a contact of a part of the user's body on a first button, whichprimarily reacts to a first touch or a first pressure, and whichsecondarily reacts to a second touch or a second pressure, and so that apointer execution command can be generated by reacting to the secondtouch or the second pressure made by a second gesture, such as pressing(or pushing) a button.

The mode shifting unit (103) may consist of a temporary mode shift modeand a permanent mode shift mode.

For example, the temporary shift mode may be configured of shifting thetext input mode to the pointing location information input mode byreacting to the first touch or the first pressure, and returning to thetext input mode when the first touch or the first pressure is removed(or released).

Alternatively, the temporary shift mode may be configured of shiftingthe pointing location information input mode to the text input mode byreacting to the first touch or the first pressure, and returning to thepointing location information input mode when the first touch or thefirst pressure is removed (or released).

The permanent shift mode may be configured of shifting the text inputmode to the pointing location information input mode by reacting to thesecond touch or the second pressure or a toggle switch, and maintainingthe pointing location information input mode even if the second touch orthe second pressure is removed (or released).

The temporary mode shift may be performed by using first controlinformation, which is received from the digital device being connectedto the multi human interface device via wired or wireless connection.

The permanent mode shift may be performed by using second controlinformation, which is received from the digital device being connectedto the multi human interface device via wired or wireless connection.

The mode shifting unit (103) may be configured to be integrated with thepointer execution command unit.

For example, when a first touch or a first pressure is detected on thepointer execution command unit, a temporary mode shift from the textinput mode to the pointer location information input mode may be set-up,and, when a second touch or a second pressure is detected, a pointerexecution command is generated, and when a third touch or a thirdpressure is applied, a permanent mode shift allowing operation to bemaintained in the pointer location information input mode, even if thethird touch or the third pressure is removed (or released), may be setup.

At this point, configuration may be made, so that, among the permanentshift modes, a pointer execution command input can be executed.

The mode shift unit may be configured on a left side surface or rightside surface of the housing (106 a, 106 b)

The mode shift unit (106 a, 106 b), which is configured on the left sideor the right side or the left side and right side of the housing, may beconfigured of a virtual button or a physical button, so as to beoperated by detecting a touch input or pressure of the user.

The mode shift unit (106 a, 106 b), which is configured on the left sideor the right side or the left side and the right side of the housing,may be configured to have an input area corresponding to 3 centimetersor more and less than 15 centimeters along the side surface of thehousing.

In case a length of the mode shift unit is less than 5 centimeters, itis preferable to set up a location of the mode shift unit to include aleft side space of a left Tab key within a Window standard keyboard.

The multi human interface device may have a transmitting unit (104)configured to transmit data via wired or wireless transmission to anexternal digital device or a digital device including the multi humaninterface device.

The digital device may receive text input or may receive pointerlocation information.

FIG. 2 illustrates a flow chart describing an exemplary operation orderrespective to mode switching of a pointing device and a text device.

The multi human interface device may have a separate power unit or maybe supplied with power from an external source via wired or wirelessconnection.

When power is supplied to the multi human interface device by using aswitch, which is configured to control the power unit, it may bedetermined whether the multi human interface device is currently in thetext input mode or in the pointing location information input mode(200).

Based upon the determined result, in case the multi human interfacedevice is in the text input mode, the text input device may beactivated, and text input may be received from the user (201).

The text input, which is inputted by the user, may be transmitted to adigital device, which is connected via wired or wireless connection(202).

While operating in the text input mode, when a mode shift occurs to thepointing location information input mode, the text input mode may beshifted to the pointing location information input mode.

Alternatively, configurations may be made, so that pointing locationinformation input is performed at the same time as the text input.

When the mode is shifted to the pointing location information inputmode, pointing location information may be received by the user's input(204).

The received pointer location information may be transmitted to thedigital device, which is connected via wired or wireless connection(205).

When the multi human interface device receives a pointer first executioncommand (206), the multi human interface device may transmit the pointerfirst execution command to the digital device, which is connected viawired or wireless connection (207).

When the multi human interface device receives a pointer secondexecution command (208), the multi human interface device may transmitthe pointer first execution command to the digital device, which isconnected via wired or wireless connection (209).

When the temporary mode shift is cancelled, or when the permanent modeshift is cancelled, the multi human interface device may shift to thetext input mode.

In case power of the multi human interface device is blocked (or cutoff) from a power switch of the power unit or there is no connecteddigital device or connection has been disconnected, or in case there hasbeen no user input for a predetermined period of time, or terminationmay be performed by a control of the digital device, which is connectedvia wired or wireless connection.

FIG. 3 illustrates exemplary embodiments of structures of a text inputdevice and a pointing device.

The multi human interface device may consist of a first housing (301)including a power unit or a control unit or a communication unit, and soon, and a second housing (302) for configuring a text input area and apointing location information input area.

The multi human interface device may have a text input device and a textinput area (303) receiving text input from the user.

At this point, the text input area (303) may be configured of a virtualbutton or a physical button.

Since a pointing location information input device is configured to havea resistive or capacitive touchpad format, the pointing locationinformation input device may be located on a physical button of the textinput device (304).

At this point, in case the text input device is configured to have aphysical touchpad format, such as a resistive or capacitive type, thetouchpad may be used as the text input device and the pointing locationinformation input device, and the touchpad may be used to have its modeshifted by a mode shift unit.

At this point, the physical touchpad, such as the resistive orcapacitive type, may be configured as a large surface touchpad typemulti human interface device (300), which is configured of a touchpad(304) including a plurality of text button areas of the text input unit.

Alternatively, the physical touchpad, such as the resistive orcapacitive type, may also be configured as a multi-touchpad type multihuman interface device (310), which is configured of a multipletouchpads (311) including one text button area of the text input unit.

Alternatively, the pointing location information input may be configuredas an upper camera type multi human interface device (320) configuring apointer location information input area (321) by an infrared camera orRGB camera (222), which is located on an upper portion of the pointinglocation information input area.

At this point, the upper camera type multi human interface device (320)may configure a virtual text input button (303) by using the uppercamera.

A lower camera (332) type multi human interface device (330), which isconfigured by positioning the camera on a lower portion of the secondhousing so as to form a pointing location information input area (331),may be configured.

At this point, the lower camera type multi human interface device (330)may configure a virtual text input button (303), which replaces thephysical text input button, by using the lower camera.

Alternatively, the camera may be configured as a transmitting/receiving(or transceiving) multi human interface device (340), which receives apointing location information input through a virtual pointing locationinformation input area (341), wherein infrared light rays or ultrasonicsound waves transmitted by an infrared light ray transmitter orultrasonic sound wave transmitter are paired with infrared light rayreceivers or ultrasonic sound wave receivers receiving information thatare blocked or interfered by a part of the user's body.

At this point, a virtual pointing location information input area, whichis formed as a pair, may be used as a virtual text button input meansinstead of the physical text button by using the mode shift unit.

FIG. 4 illustrates exemplary embodiments of a pointer execution commandunit integrated mode shifting unit.

In a button type pointer execution command unit including an elasticbody (403) configured to change its position due to a user's pressureand to return to its initial potion, when the pressure is released (orremoved), a button (402) configured to receive the user's pressure, andswitches (404, 405) configured to generate a pointer execution commandwhen touching one another by respectively changing their positions dueto the user's pressure, a pointer execution command unit integrated modeshift unit (400) may be configured, wherein a mode shift unit (401)configured to shift a text mode and a pointing location informationinput mode by detecting a touch input of the user is positioned on anupper portion of the button.

In a button type pointer execution command unit including an elasticbody (403) configured to change its position due to a user's pressureand to return to its initial potion, when the pressure is released (orremoved), a button (402) configured to receive the user's firstpressure, and first switches (404, 405) configured to generate a pointerexecution command when touching one another by respectively changingtheir positions due to the user's pressure, a pressure differentiatingpointer execution command unit integrated mode shift unit (410) may beconfigured, wherein the pressure differentiating pointer executioncommand unit integrated mode shift unit is configured of a second switchunit (411, 412) configured to generate a mode shift execution commandwhen touching one another due to the user's second pressure, which issmaller than the user's first pressure.

In the pressure differentiating pointer execution command unitintegrated mode shift unit (410), by changing the position of the button(402), the button (402) may be fixed so that it cannot return to itsinitial position due to the elastic body (403).

At this point, when the button is fixed by setting the fixed position ofthe button to a position that touches the second switch (411, 412) andthat does not touch the first switch (404, 405), configuration may beset to operate the device in a permanent mode shift mode.

In the pointer execution command unit integrated mode shift unit (400)using touch input, configuration may be made, so that a permanent modeshift switch (414) can be operated by a position change, which isperformed by sliding the button unit, and so on, and when additionalpressure is applied, while the permanent mode shift switch (414) is inan activated state, the pointer execution command switch (404, 405) maybe configured to be operated.

The pointer execution command unit integrated mode shift unit (410) isconfigured of a touch pad (421), so as to operated as a mode shift unit,when a contacting surface of the user's body part touching the touch padis within a first predetermined range, and to be operated as a pointerexecution command mode, when the contacting surface is within a secondpredetermined range.

FIG. 5 illustrates exemplary embodiments of a structure of a pointerlocation information input device.

The pointer location information input device of the human interfacedevice may include a sensor module (501) including a light emitter and acamera.

The light eminner of the sensor module (501) performs a function ofconfiguring a light plane, so that a light path can be blocked orreflected by an obstacle, e.g., the user's finger, placed on a pointinglocation information input area (108), which is configured on the lightplane consisting of light emitted from the light emitter.

The camera of the sensor module includes an optical sensor configured todetect light that is blocked or reflected by the obstacle.

The optical sensor may use a line camera, which can recognize lineimages.

It will be adequate for the line camera to have an image sensorconfigured of 400 to 1000 elements in a line format, and, preferably, itwill be ideal for the line camera to be configured of 500 to 700elements.

The line camera may include a plurality of line image sensors, which areconfigured to be one fifth to one seventh smaller than the 500 to 700elements.

The light emitter is configured as a light emitting device forconfiguring a light plane, wherein the light emitter is placed above atext input button (303) so as to be spaced apart at approximately 1millimeter.

The pointing location information input area (108) is configured as aportion of the light plane.

For example, an infrared light ray emitter, an infrared laser emitter, alaser emitter, an infrared light ray emitter, visible light emitter, andso on, may be used as the light emitting device.

It will be ideal to use an infrared laser emitter, which does notrequire a reflecting plate to be installed on edge portions, as thelight emitting device.

It will be adequate for the infrared laser emitter to operate laserhaving a laser wave of 800 to 850 nanometers at 0.3 to 1 milliWatt.

The light emitter allows the light of the infrared emitter to passthrough a line lens, so that the light can be dispersed while forming aplane.

A line lens may be further included in a light emitting unit of thelight emitter, so that the light emitted from the light emitting devicecan configure a light plane.

The line lens is positioned to allow the light emitted from the lightemitting device to configure a light plane that is substantiallyparallel to the text input unit.

The pointer location information input device may further configure anoptical filter (504), so that only the light of a specific wave rangewithin the light of the light emitter can pass through.

The optical filter (504) is installed so that light being emitted fromthe light emitter can pass through, and, additionally, when light beingreflected or blocked by an obstacle is received by a camera, the opticalfilter (504) may also be installed in front of the camera in order toprevent light that has not been emitted from the light emitter frombeing received.

Although the light emitter and the optical filter for the camera areseparately configured, it is preferable to closely install the lightemitter and the camera, so that light being transmitted and light beingreceived by one optical filter can both be filtered.

The optical filter may be designed to be perpendicular to a travellingdirection of the light of the light emitter.

Based upon an aspect of design, the optical filter may be installed at30 degrees to 60 degrees or 120 degrees or 150 degrees with respect tothe travelling direction of the light emitter.

The sensor module (501) may be installed to allow the light of the lightemitter to be directly emitted as a light plane. (510)

The sensor module (501) may further include one reflecting plate (503),so that the light of the light emitter can be emitted as a light planeafter being refracted once. (520)

At this point, the light that is reflected or blocked by the obstaclemay also be received by the camera after being refracted once by thereflecting plate (503).

The sensor module (501) may include two reflecting plates (503 a, 503b), so that the light of the light emitter can be emitted as a lightplane after being refracted twice. (530)

At this point, the light that is reflected or blocked by the obstaclemay also be received by the camera after being refracted twice by thetwo reflecting plates (503 a, 503 b).

Accordingly, a sensor module may be installed inside a first housing(301).

At this point, by coating an optical filter on the reflecting plate(503), a separate optical filter (504) may be replaced.

When the pointing location information input area (108) is activated bythe sensor module (501), by using his (or her) finger, the user inputspointing location information, moving his (or her) finger in a sweepingmotion sweeping over multiple text input buttons (303).

At this point, in order to prevent the movement of the user's fingerfrom being disturbed due to the distance between each text input button(303), it will be ideal to set the distance between each text inputbutton (303) to range from 0.1 millimeter to 1 millimeter.

Additionally, it is preferable for the text input button (303), which islocated on a lower portion of the pointing location information inputarea (108), to have upper surfaces of the multiple text input buttons tobe located on a flat plane.

A light source, which corresponds to a light source emitted from thesensor module (501) that is reflected by a reflecting plate or anobstacle and received back to the camera, passes through a light tunnel(502).

At this point, when an upper surface of the light tunnel is replaced bya portion of the first housing (301), the thickness of the housing maybe reduced.

A lower surface and side surfaces of the light tunnel may be designed asan architecture that is separate from the first housing.

FIG. 6 illustrates a structural diagram of an infrared light-ray lasersensor module.

A principle of an infrared sensor module is to basically emit lightcovering the pointing location information area by using a light source(601) and to analyze the light being reflected or blocked by an obstacleand calculate a location of the obstacle by using one camera or twocameras (603).

At this point, in order to allow the light being emitted from the lightsource (601) to be scattered, so that the light can be emitted to awanted area, a line lens (602) may be used.

It is preferable to use a line camera as a camera for recognizing astate of the light source being reflected or blocked by an obstacle.

The camera may install a guide light tunnel in front of the camera,wherein the guide light tunnel can help the light that is being receivedto receive light of a wanted area.

The light source may correspond to infrared light rays, ultra-violetlight rays, laser, and so on.

The light source and the camera may be respectively replaced withultrasonic sound waves and an ultrasonic sound wave receiver.

In order to avoid installing a reflecting plate on the edge of thekeyboard, it is preferable to use an infrared light ray laser as thelight source.

In case infrared light is to be used, a reflecting plate may beinstalled on the edge of the keyboard, or the output of the light sourcemay be increased to two times or more as compared to an optical touchmodule for general screens, or a supplemental light source may beadditionally installed.

The sensor module may have a supplemental control board (604), which isconfigured to control the light source and the camera and to deliver areceived signal of the camera to a main control board.

The pointer location information input unit may be positioned to includea portion of an extended surface of the text input unit plane.

The text input unit includes a plurality of buttons receiving at leastone text, and the button generates a text select signal by shifting froma first position to a second position due to a pressure applied theuser, and the button may be configured as a physical button format,which returns to its initial position due to its elastic body.

The text input unit includes F4 and F5 buttons within a Windows standardkeyboard, and two cameras are included as the camera of the pointerlocation information input unit, and the text input unit may bedesigned, so that, among the buttons of the text input unit, the F4 orF5 button can be configured as the button located in a position nearestto the camera located on the left side, among the two cameras.

Alternatively, the camera located on the left side may be located on anaree, to which a distance between the F4 button and the F5 button belowa spacebar of the Windows standard keyboard has performed a downwardparallel shift.

Accordingly, in case a position of an index finger of the right hand isplaced on an F position, among the text input buttons, an effect of anindex finger of the left hand blocking the camera, when pointer locationinformation is inputted by using the right hand, may be reduced.

Among the text input unit, when a button having the largest surfacearea, e.g., the space bar, is configured as the pointer executioncommand unit, for example, which mouse location information is inputtedby using the right hand, the pointer execution command unit can beeasily executed by using the left hand.

At this point, since the left hand may already be executing the modeshift unit, it is preferable to set up a minimum distance between themode shift unit and the pointer execution command unit to 8 to 15centimeters.

The mode shift unit may be provided separately from the button of thetext input unit, and the mode shift unit may be shifted to and from thetext input mode and the pointer location information input mode byrecognizing that a part of the user's body has touched a portion of thehuman interface body, and, herein, the device may be operated in thepointer location information input mode when touched, and the device maybe operated in the text input mode when untouched (or not touched).

The pointer execution command unit is configured of two buttons, and,when a first button is pressed, a first function, e.g., a left click ofthe mouse, is executed, and when a second button is pressed, a secondfunction, e.g., a right click of the mouse, is executed, and, herein,among the text input buttons, the first button corresponds to a buttonhaving the largest surface area, e.g., the spacebar, and, when thesecond button is set up as a first button located on a left side orright side of the first button, the pointer execution command unit maybe conveniently controlled by a thumb of the right hand, therebyproviding an easy and convenient user experience.

When the mode has been shifted to the text input mode or the pointerlocation information input mode by the mode shift unit, an indicationindicating the text input mode or the pointer location information inputmode may be displayed.

The display of the pointer location information input mode may betemporarily indicated at an instant when a touch occurs on the modeshift unit, or the pointer location information input area may beindicated starting from an instant when a touch occurs on the mode shiftunit to an instant when the touch is released, and, herein, theindication may be displayed as a sound or text or lighting signal.

By doing so, it will be advantageous in that the user is capable ofrecognizing the current mode status of the keyboard, and that, in caseof the pointer location information input mode, the user may be capableof easily knowing at which location the pointer location information isto be inputted.

The text input area of the text input unit may be designed to beidentical to the pointer location information input area of the pointerlocation information input unit, or the text input area of the textinput unit may be designed to include the pointer location informationinput area of the pointer location information input unit, as shown inFIG. 1.

As an exemplary embodiment for configuring the pointer locationinformation input unit, the pointer location information input unit mayinclude one or two optical emitters and cameras.

An optical signal being received by the camera may be designed to passthrough a light tunnel, so as to block out external noise light source.

The light tunnel may be configured before the optical signal is emittedfrom the optical emitter to the pointer location information input area,and the light tunnel may be installed on a front surface of the camera,which receives an input signal of the user from the pointer locationinformation input area.

At this point, a reflecting plate, which is configured to refract theoptical signal being emitted from the optical emitter or the opticalsignal being received by the camera, may be positioned.

By assigning a level of freedom in the installation position anddirection of the pointer location information input unit through thereflecting plate, an efficient usage of space in the architecture andadvantages in the design may be gained.

The pointer location information input unit may be configured to havethe pointer location information input area located at a position atleast 0.1 to 5 millimeter above the text input unit, due to the opticalemitter and the camera.

Accordingly, pointer location information may be received only when adistinctive (or accurate) touch of the user is intended.

If an infrared light ray laser having a wave ranging from 800 to 850nanometers and operating at 0.3 to 1 milliWatt is used in the opticalemitter, excellent power consumption and cost, stability, safety, andappearance may be gained.

The optical emitter may further include a line lens, which scatters theoptical signal, so that the optical signal can configure a pointerlocation information area that is parallel to the text input unit.

The pointer location information input unit may be devised to blockoptical external noise by using an optical filter, which only allows theoptical signal of an infrared light ray area to pass through.

When designed to have the distance between the physical buttons rangefrom 0.1 to 1 millimeter, the text input unit may allow the user to besufficiently provided with a soft and flat touch sensation, whileinputting the pointer location information.

FIG. 7 illustrates an exemplary embodiment indicating a pointer locationinformation input area.

The human interface device may be designed to further include pointerlocation information input display units (701, 702), which visuallydisplay (or indicate) the pointer location information input area whenin the pointer location information input mode.

The mode shift unit may be provided separately from the button of thetext input unit, and the mode shift unit may be designed to shift to andfrom the text input mode and the pointer location information input modeby recognizing that a part of the user's body has touched a portion of ahousing of the multi human interface, and, herein, the device may bedesigned to be operated in the pointer location information input modewhen touched, and to be operated in the text input mode when untouched(or not touched).

At this point, in case the part of the user's body being used forperforming the mode shift corresponds to the right hand (106 b) the modeshift unit may be designed to have the left hand perform the pointerlocation information input (108 a).

In this case, it is preferable to design the pointer locationinformation input area to be located closer to a corner facing into thecorner where the mode shift unit is located, and the design may be madeunder the same principle when the left hand and the right hand are usedin an opposite manner. (106 a, 108 b)

Conversely, the mode shift unit may also be designed to have the righthand correspond to the part of the user's body being used for performingthe mode shift and to have the right hand also corresponds to the handperforming the pointer location information input.

In this case, it is preferable to design the pointer locationinformation input area to be located closer to the corner where the modeshift unit is located instead of the corner facing into thecorresponding corner, and the design may also be made under the sameprinciple in case of the left hand.

The mode shift unit may determine the text input mode and the pointerlocation information input mode based upon a number or location of theuser's fingers recognized by the pointer location information inputunit.

The number of the user's fingers recognized when the input mode isdetermined as the pointer location information input mode is smallerthan the number of the user's fingers recognized when the input mode isdetermined as the text input mode.

For example, while the mode shift unit is controlled by using the lefthand, the finger of the left hand may be in an untouched state from thetext input button, and the index finger of the right hand may be in atouched state in order to perform pointer location information input,and, in this case, the number of fingers of the user that are recognizedis equal to one.

Conversely, when the fingers of the left hand and the right hand aretouching the keyboard in order to perform text input, the number ofrecognized fingers of the user may be recognized as 2 to 8 or less.

The pointer location information input mode display unit may betemporarily displayed (or indicated), when the input mode shifted to thepointer location information input mode by the mode shift unit, or thepointer location information input area may be visually displayed (orindicated) starting from a time point when the input mode has beenshifted to the pointer location information input mode to a time pointwhen the corresponding mode is released (or cancelled).

The pointer location information input mode display unit may be designedto be displayed from the text input button due to a visible light raygenerator or a reflected light caused by the text input button orthrough a distance between the text input buttons.

At this point, the input mode may also be displayed in case the inputmode is in the text input mode, and the indication may be displayed todifferentiate the text input mode and the pointer location informationinput mode from one another.

The pointer location information input mode display unit is configuredof surfaces (702 a, 702 b) deposited with a dye (or colorant), whichemits visible light rays by optically reacting to non-visible light raygenerators (701 a, 701 b) or non-visible light rays, and the dye may bedeposited on the text input buttons or on intervals (or spaces) betweenthe text input buttons.

The mode shift unit may further include a hand-side determination unit,which is configured to determine whether the user performed the pointerlocation information input with his (or her) left hand or right hand.

The display of the pointer location information input mode display unitmay be changed in accordance with the hand-side determination unit.

Button alignment and operation of the pointer execution command unit maybe fluidly shifted in accordance with the hand-side determination unit.

For example, in case the pointer execution command unit includes a mouseright click and left click, the buttons that are to respectively performthe mouse right click and left click may be shifted in accordance withthe determination of the hand-side determination unit.

The pointer location information input mode display unit may indicate(or display) different pointer location information input areas (702 a,702 b) in accordance with the determined result of the hand-sidedetermination unit.

When operating in the pointer location information input mode, when apointer location information input is not inputted by the user for apredetermined period of time, or when an input is received through atext input button, the mode shift unit may be designed to beautomatically shifted to the text input mode.

The pointer location information input mode display unit may be designedto recognize a pointer input area, even during the text input mode, bydepositing the text input buttons or portions of the text input buttonswith a dye (or colorant), so as to be visually indicated (or displayed)regardless of the mode of the mode shift unit.

FIG. 8 illustrates a first exemplary embodiment of a pointer locationinformation input device that can be detached from a text input device.

Being designed to be detached from a text input device (800), a pointerlocation information input device (810) may be attached (801) ordetached from (802) the text input device.

At this point, a power connection unit (820) included in the pointerlocation information input device may be supplied with power from apower source of the text input device (800).

The pointer location information input device (801) includes at leastone pointer location information input device (105 a, 105 b) and mayfurther include a control unit and an optical filter (504).

The detachable pointer location information input device (810) may beattached, so as to configure a pointing location information input areaon surface that is parallel to the text input area (801), and, by beingpositioned on a left side (803) or a right side (804) of the text inputdevice, a pointing location information input area may be configured ona bottom surface where the text input device is placed.

At this point, the pointing location information input device and thepower connection unit (820) are designed to be fluidly modified inaccordance with a location shift (or change) of the pointing locationinformation input device.

FIG. 9 illustrates a second exemplary embodiment of a pointer locationinformation input device that can be detached from a text input device.

The pointer location information input device (900) includes an internalpower unit, so as to be supplied with power from an external or embeddedbattery.

When the pointer location information input device (900) is operated ina first location information input mode (902), a housing of the pointerlocation information input device (900) may be designed to have aconstant height and angle, so that a pointer location information inputarea can be parallel to a text input area of the text input device.

Alternatively, a first location information input mode adjustmentdevice, which can adjust the height and inclination of the housing, maybe further included, so as to allow the user to arbitrarily adjust theheight and angle of the location information input area.

When the pointer location information input device (900) is operated ina second location information input mode (904), a housing of the pointerlocation information input device (900) may be designed to have aconstant height and angle, so that a pointer location information inputarea can be parallel to a bottom surface where the pointer locationinformation input device (900) is placed.

Preferably, at this point, the height of an optical filter (504) in thefirst location information input mode is higher that the height of theoptical filter (504) in the second location information input mode.

When the pointer location information input device (900) is operated ina third location information input mode (906), a housing of the pointerlocation information input device (900) may be designed to have aconstant height and angle, so that a pointer location information inputarea can be formed to include an area that is perpendicular to a bottomsurface where the pointer location information input device (900) isplaced.

In order to be capable of identifying two modes among the first locationinformation input mode, the second location information input mode, andthe third location information input mode, depending upon the state inwhich it is placed on the bottom surface, the pointer locationinformation input device (900) may include a location information inputmode sensor unit.

The location information input mode sensor unit may be configured of asensor using gravity, a sensor detecting a surface placed on the bottom,or a switch.

The pointer location information input device (900) may have any onemode of the first to third location information input modes.

Most particularly, in case of the third location information input mode(906), the mode shift for the shifting the text input mode and thepointer location information may be replaced with whether or not theuser's hand or finger has been detected in the location informationinput device (900).

More specifically, while the user is performing text input, in thelocation information input device being in the third locationinformation input mode, the user's hand or finger is not detected.

When the user places his (or her) hand or finger on an upper portion ofthe location information input device, which is in the third locationinformation input mode (906), in order to input the location informationof the pointer, the location information input device (900) is shiftedto the pointer location information input mode.

Alternatively, a digital device, which is connected to the text inputunit (800) and the location information input device (900) via wired orwireless connection, may shift to and from the text input mode and thepointer location information input mode based upon a state when thelocation information input device has detected the user's hand orfinger.

Alternatively, the location information input device (900) may transmitinformation, so as to allow the text input unit (800), which isconnected via wired or wireless connection, to perform mode shift byreceiving status information of the location information input device(900), or to allo the digital device to perform mode shift.

At this point, in case the text input is being performed, the locationinformation input device (900) may be shifted to a first power savingmode, which consumes less power than when operated in the pointerlocation information input mode.

Once the text input is stopped, during an initial first interval, thefirst power saving mode may be shifted to an active mode.

Once the text input is stopped, if the user's hand or finger is notdetected during an initial first interval, the mode may be shifted to asecond power saving mode, which consumes less power than the first powersaving mode.

In the first power saving mode, in order to determine the presence orabsence of the user's hand or finger, a sensor may be periodicallycontrolled by using less power than the active mode.

In the first power saving mode, when the user's hand or finger isdetected, the mode may be shifted to the active mode.

In the active mode, the mode may be shifted to the pointer locationinformation input mode.

In the pointer location information input mode, a pointer executioncommand unit for pointer execution commands may generate a pointerexecution command, by using a button provided on the text input device,or based upon a change (or shift) in a position or shape of the detecteduser's hand or finger.

The location information input device (900) may be activated by the modeshift unit of the text input device (800).

FIG. 10 illustrates a third exemplary embodiment of a pointer locationinformation input device that can be detached from a text input device.

The location information input device (1000) may have a housing (1001)enveloping at least two surfaces of a text input device so that the textinput device (800) can be mounted.

The location information input device (1000) is configured of a pointerlocation information input device (105 a, 105 b) and a mode shift unit(106), a control unit (1001) and a housing (1002), an optical filter(907) (1010).

The text input device (800) is mounted to the pointer locationinformation input device (1000) (1020), and, then, the optical filter islocated at a portion higher than the text input device (800), so that alight source for configuring a pointing location information input area,which is parallel to an upper portion of the text input device (800)input area, can pass through the optical filter (907).

At least one surface (1003) of the housing (1002) enveloping the textinput device may have its surface material respectively processed as amirror, transparent glass or plastic, or a light absorber of a blackcolor group in accordance with the different types of pointer locationinformation input devices, so that the light source emitted from thepointer location information input device (105) can be reflected orpenetrated (or passed through) or absorbed.

FIG. 8 and FIG. 9 and FIG. 10 correspond to exemplary embodiments of apointing location information input device that can be detached from thetext input device and have the following components.

The pointer location information input device includes a pointerlocation information input unit, which receives information related topointer location from the user.

The pointer location information input device receives pointing locationinformation of the user, which is inputted through a pointing locationinformation input area, which is configured by the pointer locationinformation input device.

The pointer location information input device includes a pointerexecution command receiving unit, which receives a signal of a pointerexecution command unit, which receives a user's command, so that atleast one function can be executed at a position where the pointer islocated.

The pointer execution command unit may be configured of a button or atouch switch, which is included in the pointer location informationinput unit, or the pointer execution command unit may be configured of acontrol unit, which shifts to a pointer execution command, when apredefined input is received, among the user inputs received from thetext input device.

The pointer location information input device includes a mode shiftcommand receiving unit, which receives a signal of the mode shift unitthat shifts to the pointer location information input mode.

The mode shift unit may be configured in the pointing locationinformation input device or may be configured in the text input deviceor may be configured as a separate device.

The pointer location information input device includes a power unitdelivering power to the pointer location information input unit and thepointer execution command receiving unit and the mode shift commandreceiving unit.

The power unit may correspond to a power unit having an embedded batteryor may correspond to a contactor being supplied with power from anexternal source.

The pointer location information input device includes a pointerlocation information transmitting unit configured to transmitinformation related to the pointer location, which is inputted to thepointer location information input unit, to a digital device, which isconnected to the human interface device via wired or wirelessconnection.

The pointer location information input area of the pointer locationinformation input unit is set to have a pre-decided height and angle, sothat the pointer location information input area can be positioned to beparallel to an upper surface of at least a portion of the text inputarea of the text input device, which is configured of multiple physicalbuttons.

In case the mode shift unit is provided separately from the text inputbuttons of the text input device, the mode shift unit may be fixed to atleast one surface of the text input device, by recognizing the receptionof a user input, the mode shift unit may transmit information indicatingthat the mode corresponds to the pointer location information input modeto the mode shift command receiving unit via wired or wirelessconnection.

The pointer location information input unit may include an opticalemitter and a camera, and an optical signal being received by the cameramay be designed to pass through an optical filter after passing througha light tunnel.

The pointer location information input device includes a location statusrecognizing unit configured to recognize location status informationrespective to gravitational information of the human interface device orlocation status information respective to a bottom where the humaninterface device is placed or location status information of the humaninterface device through an input of the user.

The location status may be configured of at least two types, and, incase of a first location status, the mode is shifted to a first pointerlocation information input mode, and, in case of a second locationstatus, the mode is shifted to a second pointer location informationinput mode

The pointer location information input area respective to the firstlocation status indicates that the pointer location information inputarea is positioned to be parallel to at least a portion of the textinput area of the text input device.

The pointer location information input area respective to the secondlocation status indicates that the pointer location information inputarea is positioned to be parallel to a bottom surface where the pointinglocation information input device is placed.

By locating an upper surface of the pointing location information inputdevice operating in the first pointer location information input mode onthe bottom surface, when shifting to the second pointer locationinformation input mode, an ordinate of the pointing location informationinput is calculated identically, whereas an abscissa of the pointinglocation information input is calculated by alternating (or switching)increasing and decreasing directions.

Among the text input buttons of the text input device, the spacebar maybe used as the pointer execution command unit, and another button thatis adjacent to the spacebar may be additionally used as the pointerexecution command unit.

The power unit may be supplied with power from the text input device.

The pre-defined height and angle of the location information input arearespective to the first location status may be defined by an adjuster,which allows the user to perform adjustment within a pre-defined range.

The adjuster may have its angle adjusted by adjusting a connection anglewith a surface that is adjacent to at least one surface of the housingof the pointing location information input device.

The adjuster may have its height adjusted by adjusting the height of atleast one surface of the housing of the pointing location informationinput device.

The adjuster may have its pre-defined angle and height adjusted byadjusting the angle and height of an optical module of the pointinglocation information input unit of the pointing location informationinput device.

FIG. 11 illustrates a front view diagram of a human interface devicehaving a low-positioned pointer location information input deviceapplied thereto.

The human interface device includes a text input unit comprising aplurality of physical buttons, a pointer location information input unitconfigured to receive information related to a pointer location from auser, a pointer execution command receiving unit configured to receive asignal of a pointer execution command unit receiving a command of theuser to perform at least one function at the pointer location, a modeshift command receiving unit configured to receive a signal of the modeshift unit shifting to a pointer location information input mode, apower unit configured to deliver power to the pointer locationinformation input unit and the pointer execution command receiving unitand the mode shift command receiving unit, a pointer locationinformation transmitting unit configured to transmit the informationrelated to the pointer location, which is inputted to the pointerlocation information input unit, to a digital device being connected tothe human interface device via wired or wireless connection. A pointerlocation information input area of the pointer location informationinput unit is located to be parallel (321) to an upper surface of atleast a portion of a text input area of the text input unit, whichcomprises a plurality of physical buttons, and wherein the pointerlocation information input unit is configured of at least two sensormodules, and wherein the at least two sensor modules are respectivelylocated on a lower left side (1102) and right side (1103) of the humaninterface device.

The pointer location information input unit comprises an optical emitterand a camera, and an optical signal that is received by the camerapasses through a light tunnel.

The mode shift unit is provided separately from text input buttons ofthe text input device.

The mode shift unit is located on a left side of a text input area ofthe text input device, and, by recognizing the reception of a user inputto the mode shift unit, the mode shift unit transmits informationindicating that the mode corresponds to the pointer location informationinput mode to the mode shift command receiving unit.

The physical button is configured of an upper portion of the button,which receives a pressure from the user's finger, and an elastic body,which applies a physical force so that the upper portion of the buttoncan return to its initial position when the pressure of the user'sfinger is removed.

The multi human interface device is provided with a reflector reflectingor an absorber (1101) absorbing a light source being generated from thepointer location information input unit on a left side, a right side,and an upper portion of the text input area and is not provided with atleast one portion on a lower portion of the text input area.

The reflector is used when the light source being generated from thepointer location information input unit corresponds to infrared lightrays, and the absorber is used when the light source corresponds toinfrared light ray laser.

At least two sensor modules (1102, 1103) of the pointer locationinformation input unit are positioned so that at least a portion of eachsensor module is included in lower portions of an outer left side areaand an outer right side area of the text input area. More specifically,a left side sensor is positioned at a location below the control buttonincluding at least a portion of a left side of a control button of astandard Windows keyboard, i.e., at a location further below toward ahousing corner where there are no control buttons. Accordingly, in orderto maximize the attractive appearance of the multi human interface, thesensor module allows the multi human interface device to be configuredat a minimum volume.

Additionally, by locating the position of the sensor near a vertex ofthe text input area (1110), having the sensor face a diagonal directionof the text input device may allow the pointer location informationinput area to be configured to have a larger surface area, as comparedto when the sensor is positioned on corner areas so as to facehorizontal and vertical directions of the text input area. Furthermore,by shifting the location of a portion having a relatively low locationinformation detection accuracy of the pointer location informationbetween a sensor and another sensor, the overall pointer locationinformation input area at an upper portion of the text input area may bemaximized.

Additionally, the location of the sensor may be located on a lower endof the spacebar in the standard keyboard, so as to have a smaller widththan the width of a keyboard (1120). The width between a sensor andanother sensor decides a width of the pointer location information inputarea, and, accordingly, although the surface area of the pointerlocation information input area is decreased as compared to when thesensor is located on the corner (1110), a relatively higher pointerlocation information detects resolution may be gained.

A distance between a sensor and another sensor eliminates the reflectoror absorber of the light source, and, by reducing the height of thehousing, when pressing on the spacebar of the standard keyboard by usingthe thumb, the thumb may be prevented from being stalled by the housing.

FIG. 12 illustrates an exemplary embodiment of a pointer executioncommand unit integrated mode shifting unit.

When an input operation leading to frequent shifting to and from thetext input mode and the pointer location information input mode isperformed, a number of sessions inputting mode shift and pointerexecution commands increases.

For example, in case of a right-handed user, when the user wishes toinput pointer location information while performing text input in thetext input mode, the user is required to perform mode shift by using his(or her) left and or right hand and, then, after inputting the pointerlocation information, the user is required to perform input to thepointer real name command unit by using his (or her) left hand.

Generally, while performing swift operation, the user tends to inputtext and pointer location information and pointer execution informationwhile locking his (or her) eyes (or eye-view) on the monitor, and,herein, in case the mode shift unit and the pointer execution commandinput unit are separately provided, this may cause the movement of thehand to occur too frequently, and by failing to correctly locate theaccurate location of the unit, the user may not be able to properlyexecute the intended function or may experience inconvenience in theworking process of having to directly look at the keyboard.

In order to resolve this problem, for example, in case of a right-handeduser, after performing text input in the text input mode, when the userplaces his (or her) left hand on the mode shift unit, a mode shiftcommand is generated, thereby shifting the mode to the pointer inputmode. Then, while the hand is placed on the mode shift unit, afterinputting pointer location information by using the right hand, whenpressure is applied on the mode shift unit, the pointer executioncommand unit may be capable of receiving the input of the user.

Accordingly, the user may share a location of the mode shift unit forperforming mode shift and a location of the pointer execution commandunit for performing pointer execution command.

As an exemplary embodiment for realizing the same, the mode shift unitis configured of a touch switch that can receive a touch input of theuser's hand and the pointer execution command unit is configured of aswitch that reacts to pressure, such as a tact switch, and is locatedbelow the mode shift unit.

At this point, a first pointer execution command unit (1104) and asecond pointer execution command unit (1105) are configured to beconnected to one another through a conductive material, which canrecognize a touch from the user's hand, or a first pointer executioncommand unit (1104) and a second pointer execution command unit (1105)are configured to be commonly connected to one another through the modeshift unit (!201), so that mode shift can be equally realized whetherthe user touches the first pointer execution command unit or whether theuser touches the second pointer execution command unit.

At this point, the mode shift activates the pointer location informationinput mode, while the touch is being applied, and the mode shift isoperated in the text input mode, when the touch is released.

In addition to touch, the mode shift performed by touch may beconfigured of another switch that is operated by a pressure lower thanthe pressure applied for the pointer execution command or may beconfigured of a sensor that can sense the location of the user's finger.

At this point, the mode shift and pointer execution command unit may belocated in an area that is differentiated from the text input area.

Preferably, in case of a right-handed user, the mode shift and pointerexecution command unit is located on an outer left side area of the textinput area.

In case the mode shift and pointer execution command unit is locatedoutside of the text input area, the possibility of the pointer locationinformation input unit confusing the respective input with the pointerlocation information input may be eliminated, and the pointer locationinformation input area may be extended.

The multi human interface device may be provided with a second modeshift unit (1202). As a switch operating as a toggle switch, each timean input is received from the user, the second mode shift unit shifts toand from the text input mode and the pointer location information inputmode. Accordingly, even though the user is not touching the mode shiftunit with his (or her) left hand, the user may be capable of performingpointer location information input by only using his (or her) righthand.

At this point, in case the multi human interface device is in the textmode due to the second mode shift unit, and in case a mode shift commandgenerated by touch is received, the multi human interface deviceoperates in the pointer location information input mode. Additionally,in case the multi human interface device is in the pointer locationinformation input mode due to the second mode shift unit, and in case amode shift command generated by touch is received, when the mode shiftcommand generated by touch is cancelled while the pointer locationinformation input mode is maintained, or when text input is received bythe text input unit, the mode is shifted to the text input mode.

At this point, when a mode shift is performed by a text input, at leasta first text input is disregarded, and when at least two or more textinputs are received, the mode may be shifted to the text input mode.

At this point, when at least two or more text inputs are received, andthe mode is shifted to the text input mode, the multi human interfacedevice transmits a text input including the disregarded at least firsttext to the digital device, and, then, the multi human interface devicetransmits newly inputted text input information to the digital device.

FIG. 13 illustrates an exemplary embodiment of using a cover of a multihuman interface device.

In order to allow the pointer location information input device to forma pointer location information input area, the multi human interfacedevice requires a space of at least 1 millimeter to 2 millimeters on anupper portion of a flat surface (or plane) of the text input device,which is configured of a physical device, and an edge for locating anabsorber for absorbing or a reflector for reflecting an optical signalmay be required to envelop the text input area and may be required to beformed on at least 3 corners.

At this point, a difference of at least 1 to 2 millimeters may occurbettween a height of the edges of the at least 3 corners and a height offlat surface (or plane) of the text input area, and a cubic (orcube-like) space is substantially formed on an upper portion of the textinput area.

The multi human interface device may be further equipped with amulti-purpose cover (1322), which is configured to protect (or guard)the text input area from external shock, on the substantial cubic-typespace (1310).

The multi-purpose cover (1322) may be detached from the multi humaninterface device (1320) and may be attached or detached due to a magnetor a physical structure.

The multi-purpose cover (1322) may be configured to have a structurethat can be folded multiple times. Preferably, as a structure that canbe folded twice, a width of at least one section of the divided sectionsmay be smaller than a width of the other section.

This allows an inclination of the multi human interface device to befurther reduced, when the multi-purpose cover is mounted on a lowerportion after being folded, in order to adjust the inclination of themulti human interface device.

After being folded, when the multi-purpose cover is mounted on thebottom surface of the multi human interface device, among the foldedsurface, a portion that comes in contact with (or touches) the groundsurface may be provided with an inclined surface (1342), so that thesurface touching the ground surface can become larger.

A wanted inclination of the multi human interface device may be adjustedin accordance with a number of folding of the multi-purpose cover(1322).

The multi-purpose cover (1322) may be internally equipped with arechargeable battery (1323) inside the cover.

An electrode of the rechargeable battery (1323) may be located on alower portion of the multi-purpose cover, and the electrode may belocated on a portion of an area that is protruded more than a portioncovering the text input area (1331), and, in case the multi-purposecover is covering the text input device (1310), the electrode may beconnected to an electrode that is provided on an upper portion of themulti human interface device.

Additionally, in case the multi-purpose cover is folded, and in case themulti-purpose cover mounted on a lower portion in order to adjust theinclination of the multi human interface device, the electrode of thebattery may be connected provided on an electrode provided on a bottomsurface of the multi human interface device.

Being connected to an external power, the multi human interface devicemay supply power to the rechargeable battery (1323) embedded in themulti-purpose cover or may separately recharge the multi-purpose cover.

At this point, a bottom surface of the multi human interface device isequipped with a covering area (1332) covering a text input area, whichhas a height that is different from the protruded edge area where theelectrode (1331) is located, and a groove where a magnet or a physicaljoining device or a cover is inserted, so that detachment or attachmentcan be performed at an accurate location.

The edge of the multi-purpose cover is deposited with a material thatcan remove (or eliminate) fine dust particles or grease, moisture, andso on, and, each time the cover is attached to or detached from themulti human interface device, foreign substances on the absorbing plateor reflecting plate or the front surface of the optical emitter and thecamera may be removed (or eliminated).

In case the multi-purpose cover is covering the text input area, whenthis is detected, the power of the multi human interface device may beturned off.

In case the multi-purpose cover is mounted on a bottom surface of themulti human interface device, the power of the multi human interfacedevice may be turned on.

Additionally, after the power is turned on, if there is no user inputfor a predetermined period of time, the power may be blocked or thedevice may be shifted to a stand-by mode.

In case the multi-purpose cover is covering the text input area (1310),the multi human interface device is substantially configured to have acubic form consisting of a thin plate, and may maximize its attractiveappearance by being designed to have no inclination when placed on theground surface and to have a smaller inclination when a multi-purposecover is mounted on the lower portion.

Meanwhile, when the multi-purpose cover is folded and mounted on abottom surface of the multi human interface device, an inclination maybe provided just as a general keyboard.

Although the multi-purpose cover is detachable, the multi-purpose covermay be designed to be folded by making downward circular movements fromthe upper surface to the bottom surface of the multi human interfacedevice due to a hinge.

FIG. 14 illustrates an exemplary embodiment of a human interface devicebeing applied to a mobile electronic device, such as a mobile electronicdevice or a tablet personal computer.

The multi human interface device (1420) may be used as an input deviceof a mobile electronic device.

A mobile electronic device including a multi human interface device maybe designed to have a structure, wherein a display unit being configuredof a display panel (1411) and a frame (1410) supporting the displaypanel is joined with the multi human interface device by a hinge (1427)so as to be covered and opened.

At this point, the display unit is configured to be inserted in asubstantially cubic space, which is configured of a text input area anda reflecting plate or absorbing plate (1424) of the human interfacedevice. Thus, a thickness of the mobile electronic device using thehuman interface device may be minimized.

In order to do so, a display unit of the mobile electronic device shouldbe designed to have a width that is smaller than the width of the humaninterface device (1420) as much as at least two times the width of thereflecting plate or absorbing plate (1423, 1424).

In other words, in FIG. 13, the device should be designed so that thedisplay unit can be inserted in a place where a multi-purpose cover isto be placed.

The display unit has a structure of having both of its corners roundedor obliquely (or diagonally) cut (1413).

When the display unit is folded, a pointer location information inputdevice (1421, 1422) is positioned on an outside of the corners that arerounded or diagonally cut.

When the mobile electronic device is folded, this is to allow the mobileelectronic device to be folded while maintaining a thin thicknesswithout being interrupted by the pointer location information inputdevice (1421,1422).

At this point, as described above, a mode shift unit and a pointerexecution command unit may be located outside the text input area on aside surface of the human interface device, or the mode shift unit maybe located on a side surface outside the text input area, and thepointer execution command unit may be operated as at least one of thetext input buttons, or both the mode shift unit and the pointerexecution command unit may be operated as at least one of the text inputbuttons.

Furthermore, more specifically, the mode shift unit and the pointerexecution command unit may be located on an outer lower portion of thetext input area (1425, 1426)

At this point, as shown in FIG. 12, although it is preferable that themode shift unit and the pointer execution command unit are configured asa single body, the mode shift unit and the pointer execution commandunit may also be separately divided and separately located.

At this point, in case the mode shift unit or the pointer executioncommand unit is located on the outer lower portion of the text inputarea, in case the user places his (or her) hand in order to control themode shift unit or the pointer execution command unit, in order toprevent the pointer location information input device (1421, 1422) frommalfunctioning as the user has inputted the location information of thepointer, the pointer location information input area should beconfigured while excluding the area where the mode shift unit or thepointer execution command unit is located.

In order to do so, by adjusting an area being covered by an opticalsignal, which is generated from the pointer location information inputdevice, the optical signal may be designed to not reach the mode shiftunit or the pointer execution command unit.

Alternatively, in order to prevent the camera from receiving an opticalsignal that is generated by a reflection or interference or blockagebetween the user's finger, which is placed on the mode shift unit or thepointer execution command unit, and the optical signal, an opticalsignal receiving angle of the camera may be adjusted, or the camera maybe configured to disregard the optical signal being received from thecorresponding direction.

The mobile electronic device is designed to include an absorbing plateor reflecting plate for absorbing or reflecting a light source, which isgenerated from the pointer location information input device, on atleast three corner portions.

At this point, when two surfaces are located on side surfaces of thehuman interface device (1423, 1424) and when one surface has the displayunit opened within a predetermined angle from a surface where thedisplay unit touches the human interface device, in order to allow thelight source, which is generated from the pointer location informationinput device (1421, 1422), to be sufficiently reflected or absorbed, thereflector or the absorber may be located in a predetermined area (1412)of the display unit corner.

In FIG. 14, the display unit may be configured of a flexible displayunit, wherein the flexible display unit covers a text input area of themulti human interface device, and, by being bent, the flexible displayunit may be fixed to be wrapped around [or to envelope] the bottomsurface of the human interface device.

Additionally, in FIG. 14, the display unit may be replaced with themulti-purpose cover, which is described above in FIG. 13, and anabsorber or reflector may be located on the corner portions of themulti-purpose cover, which are contacting the multi human interfacedevice, and, due to a hinge, the multi-purpose cover may be tilted torear surface (or backward), so as to be used for the purpose ofadjusting the height of the human interface device.

FIG. 15 illustrates an exemplary embodiment applying a low-positionedpointer location information input device and a low-positioned pointerexecution command unit.

The human interface device includes a text input unit (1501) comprisinga plurality of physical buttons, a pointer location information inputunit configured to receive information related to a pointer locationfrom a user, a pointer execution command receiving unit configured toreceive a signal of a pointer execution command unit (1505, 1506)receiving a command of the user to perform at least one function at thepointer location, a mode shift command receiving unit configured toreceive a signal of the mode shift unit shifting to a pointer locationinformation input mode, a pointer location information transmitting unitconfigured to transmit the information related to the pointer location,which is inputted to the pointer location information input unit, to adigital device being connected to the human interface device via wiredor wireless connection. A pointer location information input area of thepointer location information input unit is located to be parallel to anupper surface of at least a portion of a text input area of the textinput unit, which comprises a plurality of physical buttons, and whereinthe pointer location information input unit includes an optical signalreflector or absorber (1503 a, 1503 b, 1503 c), which is formed to behigher than a height of the text input unit, on first to third surfaces(1502 a, 1502 b, 1502 c) enveloping the text input unit, and wherein afourth surface (1502 d) enveloping the text input unit is formed to belower than the heights of the first to third surfaces, and wherein thefourth surface may include the pointer execution command unit (1505,1506).

Each of the first surface and the third surface may be respectivelylocated on a left side and a right side of the text input unit, and thesecond surface may be located on an upper side of the text input unit,and the fourth surface may be located on a lower side of the text inputunit.

The pointer location information input unit includes at least two sensormodules, and the two sensor modules may be respectively located on alower left side corner area and a lower right side corner area of thetext input unit. The mode shift unit is operated by a first input of theuser that is inputted via a first button, and the pointer executioncommand receiving unit may be operated by a second input of the userthat is inputted via the first button.

The first button may be configured of a material that can detect anelectrical signal generated by the touch of a finger, and the firstinput may be generated by recognizing the electrical signal.

While the first input is maintained, the device is operated in thepointer location information input mode, and, when the first input isreleased (or cancelled), the pointer location information input mode maybe cancelled, and the first input may be generated by physical pressure.

The mode shift unit may be operated by a second input of the user thatis inputted to a second button, and, when the second input is inputted 1time, in case the pointer location information input mode is in acancelled state, the corresponding mode may be activated, and, in casethe pointer location information input mode is activated, thecorresponding mode may be cancelled.

FIG. 1 to FIG. 15 collectively describe an example of a multi humaninterface device, which is to be described in the present invention,which will not be limited only to each of the exemplary embodimentsdescribed above, and the technical features and characteristics that aredescribed in the above-described exemplary embodiment may be applied toother exemplary embodiments that are described above. Additionally, thetypes and used technologies of the text input device pointing locationinformation input device that are included herein may be changed and/orreplaced without having the essential purpose modified or changed byanyone skilled in the art.

MODE FOR CARRYING OUT THE INVENTION

As described above, related details have been described in a best modefor carrying out the invention.

INDUSTRIAL APPLICABILITY

As described above, the present invention may be fully or partiallyapplied to a multi human interface device including a text input deviceand a pointer location information input device.

What is claimed is:
 1. A human interface device, comprising: a textinput unit comprising a plurality of physical buttons; a pointerlocation input unit comprising a plurality of capacitive touch padsformed on top surfaces of the physical buttons, respectively, thepointer location input unit receiving information indicating a pointerlocation from a user motion on the touch pads, wherein the pointerlocation indicates a location of a pointer displayed on a digital deviceconnected to the human interface device via wired or wirelessconnection; a first button configured to activate or deactivate apointer location input mode and to execute at least one function at thepointer location; and a communication unit configured to transmit thepointer location information to the digital device, wherein the firstbutton is provided in an area separate from the text input unit, whereinthe first button comprises a capacitive touch sensor detecting a usertouch input, the pointer location input mode being temporarily activatedwhile the user touch input is maintained without mechanically pressingthe first button, wherein the at least one function is executed at thepointer location when the first button is mechanically pressed, whereinthe pointer location input mode is permanently activated withoutmaintaining the user touch input while the first button is locked. 2.The human interface device of claim 1, wherein the human interfacedevice further comprises a second button configured to activate ordeactivate the pointer location input mode each time the second buttonis mechanically pressed or touched.
 3. The human interface device ofclaim 1, wherein the first button is locked when the first button isfixed to a predetermined position.
 4. A method for receiving a userinput in a human interface device, the method comprising: receiving, bya text input unit comprising a plurality of physical buttons, a textinput of a user; receiving, by a pointer location input unit,information indicating a pointer location from a user motion on aplurality of capacitive touch pads formed on top surfaces of thephysical buttons, respectively, wherein the pointer location indicates alocation of a pointer displayed on a digital device connected to thehuman interface device via wired or wireless connection; activating ordeactivating, by a first button, a pointer location input mode;executing, by the first button, at least one function at the pointerlocation; and transmitting, by a communication unit, the pointerlocation information to the digital device, wherein the first button isprovided in an area separate from the text input unit, wherein the firstbutton comprises a capacitive touch sensor detecting a user touch input,the pointer location input mode being temporarily activated while theuser touch input is maintained without mechanically pressing the firstbutton, wherein the first button executes the at least one function atthe pointer location when the first button is mechanically pressed,wherein the pointer location input mode is permanently activated withoutmaintaining the user input touch while the first button is locked. 5.The method of claim 4, wherein the method further comprises activatingor deactivating, by a second button, the pointer location input modeeach time the second button is mechanically pressed or touched.
 6. Themethod of claim 4, wherein the first button is locked when the firstbutton is fixed to a predetermined position.
 7. A human interfacedevice, comprising: a text input unit comprising a plurality of physicalbuttons; a pointer location input unit configured to recognizeinformation indicating a pointer location from a user motion on aplurality of capacitive touch pads formed on top surfaces of thephysical buttons, respectively, wherein the pointer location indicates alocation of a pointer displayed on a digital device connected to thehuman interface device via wired or wireless connection; a first buttonconfigured to activate or deactivate a pointer location input mode andconfigured to receive a command to perform at least one function at thepointer location; and a communication unit configured to transmit thepointer location information to the digital device, wherein the firstbutton is provided in an area separate from the text input unit, whereinthe first button comprises a capacitive touch sensor detecting a touchof a user, a first input is generated by recognizing the touch of theuser, the first button is operated by the first input of the user, andthe human interface device is operated in the pointer location inputmode temporarily while the first input is maintained withoutmechanically pressing the first button, wherein a second input isgenerated when the first button is mechanically pressed, the firstbutton is operated by the second input of the user, when the secondinput is recognized, the first button is operated to receive the commandto perform the at least one function at the pointer location, wherein athird input of the user is recognized via the first button while thefirst button is locked, and when the third input of the user isrecognized, the pointer location input mode is maintained as anactivation mode even if the first input is released.
 8. The humaninterface device of claim 7, wherein the human interface device furthercomprises a second button configured to receive a fourth input toactivate and deactivate the pointer location input mode, whereinwhenever the fourth input is recognized via the second button, thepointer location input mode is changed between an activation mode and adeactivation mode.
 9. The human interface device of claim 7, wherein thefirst button is locked when the first button is fixed to a predeterminedposition.